Add the following new claim: 

- -36. - - (new) The sensor system according to claim 18 wherein said mean for variable ' 
control of exposure time operates to produce successive image frames of respective long and 
short duration, the light from the stars being produced on long duration image frames and the 
light from the earth being produced on the short duration frames. 



In the Abstract 

Attached hereto is a copy of the Abstract as filed. 

REMARKS 

Careful consideration has been given to the Official Action of September 12, 2002 
and reconsideration of the application as amended is respectfully requested. 

The Examiner has raised objection to the drawing on the grounds that it fails to 
include reference numeral 8 as recited on page 6 of the specification, namely "window 8". 
We have not found this expression in the specification and it would be appreciated if the 
Examiner would point this out specifically so that appropriate amendatory action can be 
taken. The windows which allow the light passage from the stars and from the earth are 
designated in the drawing by windows 6 and 7. If as stated by the Examiner that numeral 8 is 
employed in the specification to designate one of the aforesaid windows this is in error and 
appropriate amendatory action will be taken in the specification as noted by the Examiner, 
numeral 8 is shown in Figure 2 as directed to a beam splitter. 

The Examiner objects to the specification as not containing an abstract of the 
disclosure. This is not understood as the specification was originally filed with an abstract 
and a copy thereof has been appended hereto. 

In respect of the objection raised by the Examiner concerning the recitation of "a 
space vehicle" in lines 2 and 9, amendatory action has been taken to clearly establish that 
applicant is referring to the same space vehicle as so interpreted by the Examiner. 

The Examiner has rejected claims 25-30 and these claims have been cancelled without 
prejudice thereby obviating the rejection raised by the Examiner. 
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Claims 33 and 34 have been rejected under 35 USC 1 12 on the grounds that there is 
not adequate description in the specification to make and/or use the invention. The rejection 
is respectfully traversed as the specification contains an enabling disclosure, for example on 
page 4, at paragraph 3 wherein it is recited "e.g. by means of edge filters" in order to filter out 
a long wave fraction of radiation and on page 8, last paragraph, where it is recited "an orbit- 
dependent model of the earth and of the earth's atmosphere ..." to show how the model based 
tracking is carried out. It is respectfully submitted that there is adequate disclosure of the 
subject matter of claims 33 and 34 to enable those skilled in the art to practice the invention. 

Claim 18, has been rejected under 35 USC 1 12 because the Examiner finds unclear 
the "means for variable control of exposure time". The Examiner contends that there is no 
structure or circuit mentioned in the specification that correspond to the aforesaid means". 
This quote means is supported in the specification by the description on page 3, second and 
fifth paragraphs as well as paragraph 4 on page 7 from which it is clear that the image pickup 
devices 4 include the "means for variable control of exposure time ..." and that the control of 
the exposure time is effected by choosing alternate long and short integration times of the 
image pickup devices. Claim 36 has been added as directed to this feature and as supported 
by the aforesaid description in the specification. 

The Examiner has rejected claims 18-24 under 35 USC 103 as being unpatentable 
over Falbel in view of Frame . Claims 31-35 have been rejected under the same combination 
with the addition of Billing-Ross. 

The rejection of the claims under 35 USC 103 cannot be sustained because the Frame 
patent is not available to the Examiner as a reference. Namely the Frame patent has a United 
States filing date of August 25, 1999 whereas the present application has a priority date of 
October 9, 1998 based on the German priority application. The PCT application which was 
filed on the basis of the German priority application contains a translation of the German 
application. The instant application is a national phase entry of the PCT application. The 
certified copy of the German application has been filed and a verified translation of accuracy 
thereof is attached hereto. 

Accordingly applicant's priority of his German application predates the filing date of 
the Frame patent thereby disqualifying this as a reference under 35 USC 102 or 35 USC 103 
and thereby the rejection on cited art, therefore, falls. It is also noted that the formal Falbel 
patent, cited by the Examiner as the primary reference, discloses in Column 4, lines 9-12, the 
use of an integration time of 1/3 of a second and thus a fixed integration time in contrast to 
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the different exposure time or integration time depending on the image brightness of the stars 
and the earth observations. It is respectfully submitted that the application is now in 
allowable condition, early notice of which would be appreciated. 



On the basis of the above action and comments. 



mitted, 




>ohen 
Ladas & Parry 
26 West 61 st Street 
New York, NY 10023 
Reg. No. 20302 (212)708-1887 
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IN THE SPECIFICATION 

It is also possible to compensate for the difference in brightness of stars compared to that 
of the earth, by suitable control of the exposure time or the integration time of the image pickup 
devices 4 . To this effect, during operation, exposure is always in turn, one frame long and one 
frame short. In the respective frame that has a relatively long exposure time, e.g. 0.1 sec, the 
stars are optimally acquired while in the subsequent frame with relatively short exposure time, 
e.g. 0.0001 sec, the rim of the earth is acquired particularly accurately. 



\ 



V 



C3 



o 



3 



U 013268-7 



Page-1- 



Marked up copy 



CLAIMS 

Claim 1 8 (amended) A combined earth-star sensor system for three-axis attitude 
determination of a satellite in space, said combined earth-star sensor system (1) comprising 
separate apertures with different directions of observation of earth and stars to receive light from 
the earth and stars, having respective levels of brightness and common image pickup devices (4) 
for the earth observation and the star observation [and] including means for variable control of 
exposure time of earth and star observations by said common image pickup devices depending 
o n the brightness of the earth and the stars being observed. 

Claim 20 (amended) The sensor system according to claim [19] 18, comprising an 
optical arrangement (9) for star observation, an optical arrangement (10) for earth observation 
and a semitranslucent beam splitter (8) between said apertures and the optical arrangements for 
deviating laterally entering light from the earth and transmitting light from the observed star, to 
the image pickup devices (4). 

Claim 3 1 (Amended) A method for simultaneous orbit determination and attitude 
determination of a space vehicle, comprising: 

simultaneously forming images of a star and the rim of the earth in one focal plane of a 
sensor system; 

determining attitude of the star in said focal plane; 

determining the rim of the earth by image processing; 

determining rates of rotation of the sensor system from movement of the star image in the 
focal plane; and 

calculating at least one of orbit and altitude of [a] the space vehicle carrying the sensor 
system, wherein 

exposure or integration time of the sensor system is alternatingly adapted to a difference 
in brightness of the light from the star and the earth. 
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Claim 34 (amended) The method according to claim 31, comprising filtering a long- wave 
fraction of the [radiation] light used for determining the rim of the earth. 
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CERTIFICATION OF TRANSLATION 



"PCT/DE99/03204" 

I, Roland Meier, c/o Technisches Fachuberset zungsburo, 
Forsterweg 33, A-2136 Laa/Thaya, Austria, 

am the translator of the documents attached and certify that 
the following is an accurate and literal translation to the 
best of my knowledge and belief. 




dated this 1 st day of March 2001 



A combined earth- star sensor, system and a method for 
detennining the orbit and attitude of space vehicles 

The InvenLion relaLes lo a coitibixied ecLrLh-eLor yyubur 
system for three- axis attitude determination of 
satellites in apace; as well as a method for 
determining the orbit and attitude of space vehicles. 

For eart.h-oTi enteri BateUites, intrared sensors are 
presently ueed to determine roll and pitch angles, 
while solar sensors are used to determine the yaw angle 
of the satellite. This solution is associated with the 
disadvantage of the arrangement of several solar sensor 
heads used being very expensive, and of the lack of any 
yaw reference in the case of co-linearity of - the earth 
and the eun. Furthermore, evaluation additionally 
recjulres an exact knowledge of the attitude of the 
satellite on its orbit. Moreovar, errors between the 
uitjcLULLL-iiiy dxee of suldr uuiiaors dj.it! ecti/Lli aeiiaore, e.g. 
caused 1 by inac curacies during installation or as a 
result of thermal influence, can significantly degrade 
the r[ua 1 i ty of TTtfiapnrernerits - 

Known star se.-nsnrs provide a three - a* i a ar.ti tilde 
reference in an inert ial system. Here too f earth 
alignment requires an exact knowledge ot the satellite 
attitude. At present, CCDs are used for such star 
sensors. Due to their lack of radiation resistance, 
they arc not suitable for udc in orbitc with 
substantial radiation load, e.g. for use in 
geosynchronous missions , 

From EP 0 589 3 87 Al a combined earth- star sensor 
system is known which usee a sinqle optical arrangement 
to carry out both star observation and earth 
observation in the UV ranye. Tu carry out common 
observation, the optical arrangement comprises a wide- 
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angle system incorporating a mirror system. Due to the 
coinciding directions of obBeivdLluu Cor earth 
observation anri star- observation, the known system is 
only able to observe stars in proximity to the earth; 
and due to the sensor being designers with the fitrnng 
earth radiation in mind, for attitude determination the 
known system ie only able to observe stars ot high 
intcnoity. 

It is thus the object of the invention to provide a 
combined earth-star sensor system which is not limited 
in regard to the oelootion of otaro ouitablo for 
observation, and which can be produced economically. 
Furthermore, it is the object of the invention to 
provide a method for determining the orbit and attitude 
of a space vehicle, said method being more accurate and 
allowing independent on -board opera Li on. 

This object is met by the combined earth-star sensor 
eyetem according to .claim 1 and the method according to 
claim 5, Further advantageous characteristics, aspects 
and details of the invention are provided in the 
dependent claims, the description and the drawings. 

The combined earth- star sensor system according to the 
invention, for three -axis attitude determination of 
satellites in space comprises separate apertures with 
different directions of observation and common image 
pickup devices for the earth sensor and the star- 
sensor. 

Observation according to the invent ion, of Uht; tsa..rLh 
and the stars with different apertures makes it 
possible to observe stars of may uiL tide 5 Loo. The 
considerable difference in the intensity of radiation 
of LUeaw wLars when compared to earth radiation, can be 
absorbed by different speT*tnre design and filtering. In 
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spite of oonourrent observation of the earth/ the 

detection of the stars is not influenced Jay the 

scattered light from the earth, if two apertureo are 

used, The simple design of the system according to the 
j invention can cops with high light intensities while 

! keeping costs low. High lighL ijiLeiibiLy allows the uae 
. ! of economical CMOS image "pickup devices. 

Preferably the CMOS image pickup devices form a CMOS 
focal plane array as a focal plane sensor , with a 
| dynamic range of up to 1:10*. Tt ma Ices possible 

J variable control of the exposure time, so that 

integration can be adapted to the difference in 
brightness of the stars and the earth. 

By ucing an alternative proposal of two different 
optical arrangements instead of a common optical 
arrangement , the wavelength bands U3cd for detection 
can be optimised independently of each other. 

The integrated sensor system according co the invention 
makes it possible to determine three attitude angles, 
three angle speeds, and the aLlitude of Uiu ypace 
] vehicle. Software control makes it possible to cover 

: different orbits such as geosynchronous orbiua, 

transfer orbits as well as low, middle and elliptical 
orbits . 

Furthermore, the sensor makes possible variable control 
: of the exposure time so that integration can be adapted 

to the difference in brightness of the stars and the 
earth. Preferably, exposure is always in turn, one 
frame long and one frame short. 

! The method according to the invention comprises the 

j following steps: 

i 

i 



simultaneous imaging of stare arid rim of the earth in 
one focal plane of a sensor system; determining the 
star attitude in the focal plane; determining the rim 
of the earth by image processing; determining rates of 
rotation of the sensor system from the movement of the 
bLd.£- image in Lhe facctl plcuiw; e±ud CdlculetLluy Lhe 
orbit and/or attitude of a space vehicle which carries 
the sensor eye tern. 

With the device and the method, highly accurate 
intormation on the orbit and the attitude of the space 
vehicle or satellite oan be obtained concurrently. 

By alternate adaptation of tho oscpoourc time or the 
integration time of the sensor or of the image pickup 
device, to the brightness of the stars and the 
brightness of the earth , even stars which are less 
bright can be acquired concurrently with the rim of the 
earth. By filtering out or acquiring <a luiiy-w<4ve 
fraction of the radiation, e.g, by meane of edge 
filters, the rim of the earth can be avquixtsd 
particularly well and with particularly good stability. 
Additional degrees of freedom can be determined by 
morifil -haflftd tracking of the rim of the earth. 

Fnrhhftr advantage of fcha invention include a lower 
mass or possible redundancy because there is no need 
for- further ernn pmant such as for example gyros which 
were hitherto required for determining the orbit and 
the attitude. This results in simplified integration 
and inherent radiation resistance, Orbit determination 
is possible without the use of GPS, in particular alao 
for near earth and geostationary satellites. In this 
way. independent on- board operation can be achieved. 

Below, embodiments of the invention are explained in 
more detail by means of the drawing. 
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figure l shows a combined earth- star sensor ayt*Lem with 
a common optical arrangement ,* 

Figure 3 shows a combined earth- star sensor system with 
two optical arrangements,- 

Figuxe 3 shows an arrangement of image pickup dcvicco; 
and 

Figure 4 shows a coordinate system whose z-axls iB 
directed towards the centre of the oarth and 
whosfi X-axis points in the direction of orbit 
movement . 

The combined carth-atar sensor system 1 shown in Figure 
l comprises a common optical arrangement 2, a 
deflection mirror 3, image pickup devices 4 and windows 
6 and 7 for earth and star obae-n vauion. 

The system shown is in particular characterised in that 
the observation direction to the earth ditt'ers trom the 
observation dix-tsuLion to the stare. 

StarliyhL enters the window G, paeeee the little 
deflection mirror 3, reaches the common optical 
arrangement 2 and is focus scd onto the image pickup 
device 4. The light from the earth enters through the 
window 7, impinges on the deflection mirror 3 which 
directs it to the common optical arrangement 2, The 
common optical arrangement 2 focuoec the light from the 
earth on the image pickup devices 4. in relaLion to a 
common optical arrangement 2, the image pickup devices 
4 are arranged on a common focal plane according to a 
specified pattern. Figure 3 provides em §*vample of a 
possible arrangement of four image pickup devices which 
provide coverage over a large field of vision at a 
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minimum number of pixels. Pior example, known CCD 
component b can be used as image pickup devic.es, but: 
other components such as e.g. CMOS image pickup devio e 
can also be used. 

Thti apttx-Lux-fci fur eaxLh observation is a small aperture 
which during observation of fainter stare preferably 
avoids interfering scattered light from the ea£Lh, and 
attenuates intensive sunlight which occurs at times 
when the sun appearp in the beam path to the earth > The 
image ot the earth through window 7 and the Images of 
the stars through window 8 are superimposed on the 
image pickup devices. 

The evaluation system of the combined earth- star sensor 
cyotem 1 achieve a the ocparation of oarth image from 
scar image e.g. in the following way: the rim of the 
earth is roughly determined in the image, i.e. 
determination is not to subpixel accuracy, then the 
image of the stars which are clearly attitudeed outside 
the earth' s disk are evaluated; to this effect the 
stare are compared with the star chart; in the star 
cluirU, those atarw are determined whose image is too 
close to the rim of the earth, e.g. up to 3 pixels, and 
which would thus diaLurb an e^dcl lucaLiuii 
determination; the rim of the earth is then located to 
subpixel accuracy, with those pixels not being counted 
which are too close to disturbing stars. 

It the difference in apertures is sufficient, then the 
stars which can be observed through the earth aperture 
do not interfere; their light is attenuated too much by 
the smaller aperture. Sun and moon however have to be 
taken into account, but on account of their large 
surface area they can easily be differentiated from 
stars. 
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As an alternative to fch* rtysteift with a common optical 
arrangement. Figure 2 shows a system with separate 
optical arrangements for observing the earth and the 
stare. In this case the combined earth- stair sensor 
system 1 comprises a s Ami trans'! n cent beam splitter 8, 
an optical arrangement 9 for star observation, an 
optical arrangement 10 if nflfWifiary with a def Taction 
mirror 11 for earth observation arranged upstream of 
said optical arrangement, ae well as windows & and y 
and image pickup deviaee 4, 

t 

The optical arrangement 10 for earth obcervation io 
directly inserted in window 7. Via the semi translucent 
beam splitter S # said optical arrangement forme an 
image on the image pickup devices 4 , of the earth 
radiation received, if necessary via an outer 
deflection mirror 11 . Via the* beam splitter 6, the 
optical arrangement 9 forms an image on the image 
pickup devices 4, of the starlight received through 
window 6. Figure 2 shows the image pickup devices 4 in 
a common focal plane to the beam splitter 8. Hie 
optical characteristics ot the -two sensors can be such 
that they compensate for differences in intensity; they 
can also be of° different focal length and comprise 
additional attenuation filters in the beam path, 

Ae is the case in the system described in the context 
of Figure 1, the aperture for earth observation is 
attenuated and smaller than jthe aperture for star 
observation, and the observation direction ro the earth 
differs from the observation direction to the stare. 

It is also possible to compensate for the difference in 
briylitiifciou uf 6Lar£ compared to that of the earth, by 
suitable control of the exposure time or the* 
inteqration time. To this efleul, during operation, 
exposure is always in turn, one frame long and one 
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frame short . In the respective frame that has a 
ieleiLjL vtjly loiiy exposure time, e.g. 0.1 sec, the scars 
are optimally acquired while in the subsequent frame 
with relatively short exposure Lime, e.y, 0.0001 sec, 
the rim nf the earth is acquired particularly 
accurately. 

First the star attitude is determined in the image 
plane. Then., by tracking the anquireri stars, the 
dx <fy 

movements (— , — ) of the stars in the image plane are 
obtained. Subsequently, the rates of rotation {^ X7 m >7 &.) 
are determined by salving the following equations: 



with f denoting the focal length o£ the optical 
arrangement;. The degrees of freedom of rotation of the 
space vehicle dan be determined by tracking at least 2 
stars {x t9 y t ) in the image pi dine. 

To explain the ecnaations, Figure 4 shows the image 
plane x, y and a system of coordinates, with the 
satellite travelling in the x direction and with the Z- 
axis pointing to the centre of the earth. The rates of 
rotation & x ,<D y ,tD xt reflect the roll, the pitch and yaw 

of the satellite or space vehicle. 

In the next step the rim of the earth is determined to 
subpixel accuracy, after respective segmentation. For 
this purpose, an orbit -dependent model of the earth and 
of the earth' e atmosphere ie fitted to the intensity 
distribution in the* image plane. It must be taJcen into 





(1) 
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account that the image has already been defooueed (via 
2-3 pi**jlw) Itji star attitude determination at 
subpixel accuracy. For determination. to subpi*el 
accuracy there is an iiiLerpulauiuu btsL-wtifciii Llie 
individual pixel values. Segmentation, i.e. separation 
of the image according to earth and star, results in 
improved accuracy. 

Tf t.hfi esarnh ifi imagfirl in i hfi Ftnt.i rety nr as a 
sufficiently curved segment of a circle, the vector to 
the centre of the earth can be estimated. 

Now the following formula is used to determine the 
orbital movement (v x/ v y , v z ) T of the satellite from the 

image movement of the xim of the earth < * * ) : 

at at 

£-//2*(-v + * V ,) + C x 

2 denotes the distance to the earth's horizon which in 
this caac is constant . C x , Cy arc constants which . 
depend on the Jcnown rates of rotation as follows: 




Again, two points (x, y) T of the rim of the earth are 
suCficienL Lo estimate the orbit componente. If Z is 
unknown, the speeds can only be determined up to a 
conyLctuL IfcicLor. If the rim of the earth is only imaged 
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as a linear or quaei -linear element, then (2) only 
contains a measurement for the unknown quantities v x , 

Thus simultaneous orbit determination and attitude 
determination cd.ii thus for exatnple take place via the 
following steps : 

a) Determining the star attitude in r.he focal plane by 
meetuw of & method with subpixel accuracy, euch as 
e.g. centTOiding; 

b) Determining the rates of rotation by tracking Llie 
cent road of a surface of the stare and inverting the. . 
image aquations; 

c) Determining the rim of the earth by model -supported 
image -proccooing methods with eubpixel accuracy; 

d) Estimating the centre of the earth from the image of 
the rim of the eaxLh, as far as possible; and 

e) Model -baaed tiackixicj of the rim of the earth so ao 
to obtain additional degreftfi of freedom. 



CLAIMS 



1. A combined earth-star sensor system for th-ree-axis 
attitude deLunulA&Lion of satellites in space, 
characterised in that the nombinert earth- star 
sensor system (1) comprises separate apertures 
with different direction* nf observation and 
common image pickup devices (4) for the earth 
sensor and the star senior. 

2. The sensor system according to claim 1, 
characterised in that tho earth-star sensor system 
(1) comprises a common optical arrangement (2) £or 
earth observation and star observation, and a 
deflection mirror (3) for deviation ol the 
laterally entering light from the earth, to the 
common optical arrangement (2) . 

3. The ssenwux- system according to claim 1, 
characterised in that the earth -phar sensor system 
(1) comprises an optical arrangement (0) for star 
observation, an optical arrangement (10) for earth 
observation and a semitranslucent beam splitter 
(8) for deviating the laterally entering light 
from the earth and transferring the starlight 
whinh enters in longitudinal direction, to the 
image pickup devices (4) . 

4 . The sensor system according to one of claims 1 to 

3, characterised in that the aperture for the 
light from the earth ie considerably smaller than 
the aperture for the starlight, 

b, The sensor system according to one of claims 1 to 

4, characterised in that the* evaluation system of 
the sensor system by ineaiis of a star catalogue or 
similar prior knowledge rii ^regards those areas in 
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the image where the image of the rim of the earth 
and Images of scars axe superimposed, thus 
eliminating' influences of interference concerning 
the accuracy of deterniiiUuy the riui of the earth 
in the image . 

6. A method for simultaneous orbit detftrmi nation and 
dttlLude determination of a apace vehicle, 
characterised by the steps: 

- Simultaneous imaging of scars and the rim of the 
earth in one focal plane of a censor system/ 

Determining the star attitude in the focal 
plane; 

- Determining the rim of the t-uxth by image 
processing/ 

- Determining the rates of rotation of th* sensor 
system from the movement of the star image in 
the focal plane; and 

- Calculating the orbit anri/or attitude of a space 
vehicle carrying the sensor system. 

1 . The method according to claim 6 , further 
characterised by model -based cracking of Che rim 
of the earth. 

8 . The method according to claim 6 or 7 , 
characterised in that a long- wave I r action of the 
radiation ia filtered out and used for determining 
che rim of che earch. 



The method according to one of claims 6 to 8, 

characterised in that the rim of the earth is 
determined by fitting earth models. 

Tho method according to one of elaims 6 to 9, 
'characterised in that eApybuie time or integration 

time ie adapted in turn to the difference in 
brightness of the slurs and of the earth. 



